iCHECK-DH: Guidelines and Checklist for the Reporting on Digital Health Implementations.

BACKGROUND: Implementation of digital health technologies has grown rapidly, but many remain limited to pilot studies due to challenges, such as a lack of evidence or barriers to implementation. Overcoming these challenges requires learning from previous implementations and systematically documenting implementation processes to better understand the real-world impact of a technology and identify effective strategies for future implementation. OBJECTIVE: A group of global experts, facilitated by the Geneva Digital Health Hub, developed the Guidelines and Checklist for the Reporting on Digital Health Implementations (iCHECK-DH, pronounced "I checked") to improve the completeness of reporting on digital health implementations. METHODS: A guideline development group was convened to define key considerations and criteria for reporting on digital health implementations. To ensure the practicality and effectiveness of the checklist, it was pilot-tested by applying it to several real-world digital health implementations, and adjustments were made based on the feedback received. The guiding principle for the development of iCHECK-DH was to identify the minimum set of information needed to comprehensively define a digital health implementation, to support the identification of key factors for success and failure, and to enable others to replicate it in different settings. RESULTS: The result was a 20-item checklist with detailed explanations and examples in this paper. The authors anticipate that widespread adoption will standardize the quality of reporting and, indirectly, improve implementation standards and best practices. CONCLUSIONS: Guidelines for reporting on digital health implementations are important to ensure the accuracy, completeness, and consistency of reported information. This allows for meaningful comparison and evaluation of results, transparency, and accountability and informs stakeholder decision-making. i-CHECK-DH facilitates standardization of the way information is collected and reported, improving systematic documentation and knowledge transfer that can lead to the development of more effective digital health interventions and better health outcomes.

Correction: iCHECK-DH: Guidelines and Checklist for the Reporting on Digital Health Implementations.

[This corrects the article DOI: 10.2196/46694.].

Evaluation of the Efficiency of Telemedicine in the Management of Cardiovascular Diseases in Primary Healthcare in Sub-Saharan Africa: A Medico-Economic Study in Cameroon.

OBJECTIVE: To assess the efficiency of tele-expertise (tele-ECG) for patients and for health facilities in managing patients with cardiovascular diseases (CVDs) in primary health care in Cameroon. METHOD: This study was a medico-economic study combining two approaches: cost minimization and cost-effectiveness analysis. It was conducted alongside the previous published controlled multicenter study carried out in Cameroon's two health facilities where tele-ECG has been implemented (intervention centres) and two other where telemedicine has been not implemented (control centres). RESULTS: The average total cost for patients was 9 286 F CFA (US$: 16) in the intervention centres compared to 28 357 F CFA (US$: 49) in the control centres (p <0.01). The calculated ICER favouring tele-ECG was 25 459.6 F CFA (US$: 44). DISCUSSION: Telemedicine is efficient for managing patients with CVDs in primary health care in Cameroon. It enables health facilities in remote areas to offer new healthcare services at a lower cost and improve patients' financial access to healthcare.

Evaluation of the Effectiveness of Telemedicine in the Management of Cardiovascular Diseases in Primary Health Care in Cameroon: An Interventional Study.

OBJECTIVE: This study aimed to evaluate the effectiveness of tele-expertise (tele-ECG) in primary health care in Cameroon for the management of patients with cardiovascular diseases or risk factors. METHOD: It is a controlled multicenter study carried out in Cameroon's two health facilities where tele-ECG has been implemented (intervention centers) and two other where telemedicine has been not implemented (control centers). Patients having cardiovascular risk factors or diseases received usual primary health care in the control centers. In contrast, they received usual primary health care and could perform an ECG associated with cardiologists' remote expertise (tele-ECG) in the intervention centers. The primary outcome was to evaluate the rate of patients' access to an ECG test and to cardiologist' expertise. RESULTS AND DISCUSSION: Telemedicine is effective for the management of patients with cardiovascular diseases in primary health care. It could improve healthcare providers' clinical processes, clinical outcomes of patients and their satisfaction.

Implementation of a national electronic health information system in Gabon: a survey of healthcare providers' perceptions.

BACKGROUND: The Health Information System (HIS) is a set of computerized tools for the collection, storage, management, and transmission of health data. The role of such tools in supporting the modernization of health systems, improving access to quality healthcare, and reducing costs in developing countries is unquestionable, but their implementation faces several challenges. In Gabon, a unique national electronic HIS has been launched. It will connect healthcare institutions and providers at all levels in the whole country. OBJECTIVE: This study aims to explore and identify the factors influencing healthcare providers' perceptions of the national electronic HIS in Gabon. METHODS: A 44-item questionnaire based on the Information System Success Model (ISSM) was administered between February and April 2018 among 2600 healthcare providers across the country. The questions assessed the different aspects of the HIS that could influence its perceived impact on a 5-level Likert scale (from fully agree to totally disagree). The reliability and construct validity of the questionnaire were checked using Cronbach alpha and congeneric reliability coefficients. A logistic regression was used to identify the factors influencing healthcare providers' perceptions of the system. RESULTS: A total of 2327 questionnaires were completed (i.e. 89.5% response rate). The logistic regression identified five elements that significantly influenced perceived system impact: System Quality (Odds Ratio-OR = 1.70), Information Quality (OR = 1.69), Actual Use (OR = 1.41), Support Quality (OR = 1.37), and Useful Functions (OR = 1.14). The model explained 30% of the variance in providers' perception that the national HIS leads to positive impacts. DISCUSSION: The results show that healthcare providers' perceptions regarding the positive impact of the national HIS in Gabon are influenced by their previous use of an HIS, the scope of their usage, and the quality of the system, information, and support provided to users. These results could inform the development of strategies to ensure adequate change of management and user experience for the implementation of the national HIS in Gabon, and eventually in other low resource environments.

État des lieux du système d'information sanitaire du Gabon.

OBJECTIVE: The need for an efficient and reliable health information system motivated Gabon, with the support of the World Bank, to finance a project to reinforce its health information system. An audit of this system was required to report on the reality of the existing system and tools. METHODS: Over the course of two periods, May to September 2016 and April to May 2018, information was collected using both qualitative and quantitative approaches. In this framework, were carried out successively: participative workshops including health actors in Gabon, a survey of health care workers, an analysis of reference documents relating to national health policies, and an analysis of the strengths, weaknesses, opportunities, and threats to the system. RESULTS: In total, 171 health care professionals participated in the different workshops, and 770 others were questioned among 150 health care establishments from 10 health care regions of the country. At the end of this research work, organizational and technical problems were noted at the level of the health information system of Gabon, notably the absence of a judicial framework defining the roles and responsibilities of the different actors of the system, weak data management, a stovepipe information system, several non-interoperable IT applications, and weak completeness rate, at 30%. Among the 770 health care professionals surveyed, 539 (70%) were favorable to a new information system. As for the main assets, we noted the existence of computing equipment and acceptable internet coverage, 31.5% of the health care establishments are connected via cable. CONCLUSION: This research sheds light on the existing health information system and should enable the implementation of a new system.

A Teledermatology Pilot Programme for the Management of Skin Diseases in Primary Health Care Centres: Experiences from a Resource-Limited Country (Mali, West Africa).

In sub-Saharan Africa, in particular in rural areas, patients have limited access to doctors with specialist skills in skin diseases. To address this issue, a teledermatology pilot programme focused on primary health centres was set up in Mali. This study was aimed at investigating the feasibility of this programme and its impact on the management of skin diseases. The programme was based on the store-and-forward model. Health care providers from 10 primary centres were trained to manage common skin diseases, to capture images of skin lesions, and to use an e-platform to post all cases beyond their expertise for dermatologists in order to obtain diagnosis and treatment recommendations. After training, the cases of 180 patients were posted by trained health workers on the platform. Ninety-six per cent of these patients were properly managed via the responses given by dermatologists. The mean time to receive the expert's response was 32 h (range: 13 min to 20 days). Analysis of all diseases diagnosed via the platform revealed a wide range of skin disorders. Our initiative hugely improved the management of all skin diseases in the targeted health centres. In developing countries, Internet accessibility and connection quality represent the main challenges when conducting teledermatology programmes.

Telemedicine as a tool for digital medical education: a 15-year journey inside the RAFT network.

This paper presents the evolution and growth of continuous medical education through the Réseau en Afrique Francophone pour la Télémédecine (RAFT) network. RAFT is a telemedicine network present on four continents and built through years of experience, with the goal of supporting isolated healthcare professionals by providing them with the right expertise at the right time using affordable, low-bandwidth technologies. Much more than a platform to share and exchange knowledge, RAFT has put in place a solid local infrastructure to ensure the sustainability and maintenance of the network. From experience gained with South-South collaboration to top-down and bottom-up approaches and various certification models, much know-how has been acquired and different perspectives for improvement have been proposed. The results we have collected from these 15 years of practice are presented in this paper through lessons learned and key takeaways. Perspectives for future development supported by concrete examples conclude the paper.

The influence of a telehealth project on healthcare professional recruitment and retention in remote areas in Mali: A longitudinal study.

OBJECTIVES: The telehealth project EQUI-ResHuS (in French, Les TIC pour un accès Équitable aux Ressources Humaines en Santé) aimed to contribute to more equitable access to care and support practice in remote regions in Mali. This study explored the evolution of perceptions concerning telehealth among healthcare professionals in the four district health centres that participated in the EQUI-ResHus project and identified variables influencing their perceptions of telehealth impact on recruitment and retention of health professionals. METHODS: One year after a first survey (T1), a second data collection (T2) was carried out among healthcare professionals using a 91-item questionnaire. Questions assessing telehealth use and perceptions and perceived impact on recruitment and retention of healthcare professionals were rated on a 5-point Likert scale. A total of 10 independent variables were considered for the analyses. A Wilcoxon signed-rank test was performed to detect differences between T1 and T2, and a bivariate linear regression model for repeated measures was carried out to assess the impact of independent variables on dependent variables. RESULTS: There were no noticeable changes in perceptions related to telehealth influence on recruitment and retention. Only access to information and communication technology significantly differed between T1 and T2 according the Wilcoxon rank test (p = 0.001). Perceived influence of telehealth on recruitment and retention was mostly explained by attitude towards telehealth, perceived effect on recruitment and retention and barriers to recruitment and retention. CONCLUSION: Based on our results, telehealth was perceived as having a positive influence but mostly indirect influence on healthcare professional recruitment and retention. Also, there were no major changes after 1 year of telehealth use.

Reverse innovation experiences from the RAFT e-learning and telemedicine network.

Available infrastructure, resources, and provided services in low-and middle-income countries differ significantly from high-income countries. In healthcare for example, the uneven distribution of health professionals and lack of human resources are real barriers to equitable access to quality health care and services in most developing countries and particularly in Sub-Saharan Africa. As available resources are lower and infrastructure is les developed many services and tools that have been developed for a high-income context cannot be used or are not sustainably affordable in a low-income environment, which led to the development of tools and services that are affordable and appropriate for this context. This ranges from concepts of blended learning, over tools for distance education and diagnostic to hardware like affordable and robust ultrasound machines and services like mobile payment. Many of these solutions and tools also have a great potential to be utilized in a different context and some of them have been deployed in high-income countries.

E-Health, another mechanism to recruit and retain healthcare professionals in remote areas: lessons learned from EQUI-ResHuS project in Mali.

BACKGROUND: The aim of this study was to evaluate the perceived influence of telehealth on recruitment and retention of healthcare professionals in remote areas in Mali. METHODS: After 15 months of diagnosis imaging training and telehealth activities at four project sites in remote Mali, between May 2011 and August 2012, a 75-item questionnaire was administered to healthcare professionals to assess the various factors related to Information and Communication Technologies (ICT), especially telehealth, and their influence on health personnel recruitment and retention. Questions assessing perceived impact of telehealth on recruitment and retention of healthcare professionals were rated on a five-point Likert scale. Dependent variables were perceived influence of ICT on recruitment and retention and independent variables were access to ICT, ICT training, ICT use, perceived benefits and drawbacks of telehealth, and perceived barriers to recruitment and retention. A multiple linear regression was performed to identify variables explaining the respondents' perceptions regarding telehealth influence on recruitment and retention. RESULTS: Data analysis showed that professionals in remote areas have very positive perceptions of telehealth in general. Many benefits of telehealth for recruitment and retention were highlighted, with perceived benefits of ICT (p = 0.0478), perceived effects of telehealth on recruitment (p = 0.0018), telehealth training (0.0338) and information on telehealth (0.0073) being the strongest motivators for recruitment, while the perceived effects of telehealth on retention (p = 0.0018) was the only factor significantly associated with retention. CONCLUSIONS: Based on our study results, telehealth could represent a mechanism for recruiting and retaining health professionals in remote areas and could reduce the isolation of these professionals through networking opportunities.

The RAFT Telemedicine Network: Lessons Learnt and Perspectives from a Decade of Educational and Clinical Services in Low- and Middle-Incomes Countries.

BACKGROUND: The objectives of this paper are to (i) provide an overview of the educational and clinical experiences of the Réseau en Afrique Francophone pour la Télémédecine (RAFT) network, (ii) analyze key challenges and lessons learnt throughout a decade of activity, and (iii) draw a vision and perspectives of its sustainability. METHODS: The study was carried out following three main stages: (i) a literature review, (ii) the analysis of key documents, and (iii) discussions with key collaborators of the RAFT. RESULTS: Réseau en Afrique Francophone pour la Télémédecine has been offering an important quantity of educational, clinical, and public health activities during the last decade. The educational activities include the weekly delivery of video-lectures for continuing and post-graduate medical education, the use of virtual patients for training in clinical decision making, research training activities using ICTs and other e-learning activities. The clinical and public health activities include tele-expertise to support health professionals in the management of difficult clinical cases, the implementation of clinical information systems in African hospitals, the deployment of mHealth projects, etc. Since 2010, the RAFT has been extended to the Altiplano in Bolivia and Nepal (in progress). Lessons Learnt and Perspectives: Important lessons have been learnt from the accumulated experiences throughout these years. These lessons concern: social and organization, human resources, technologies and data security, policy and legislation, and economy and financing. Also, given the increase of the activities and the integration of eHealth and telemedicine in the health system of most of the countries, the RAFT network faces many other challenges and perspectives such as learning throughout life, recognition, and valorization of teaching or learning activities, the impact evaluation of interventions, and the scaling up and transferability out of Africa of RAFT activities. Based on the RAFT experience, effective integration and optimum use of eHealth and telemedicine in low- and middle-income countries (LMICs) health systems should take into account the context (resources, infrastructure, and funding), the needs of key stakeholders, and the results derived from theoretical and practical experience. The relevant items highlighted to illustrate the sustainability of the RAFT network and the analyses performed in this study, should serve as discussion basis for the development of eHealth and telemedicine in LMICs.

Medical and economic benefits of telehealth in low- and middle-income countries: results of a study in four district hospitals in Mali.

BACKGROUND: The aim of this study was to evaluate the impact of telehealth on 1) the diagnosis, and management in obstetrics and cardiology, 2) health care costs from patients' perspectives, 3) attendance at health centres located in remote areas of Mali. METHODS: The impact of telehealth on health care utilization, quality, and costs was assessed using a five-point Likert-scale based questionnaire consisting of three dimensions. It was completed by health care professionals in four district hospitals. The role of telehealth on attendance at health centres was also assessed based on data collected from the consultations logs before and during the project, between project sites and control sites. Referrals specific to the activities of the research study were also evaluated using a questionnaire to measure the real share of telehealth tools in increasing attendance at project sites. Finally, the cost savings achieved was estimated using the transport and lodging costs incurred if patients were to travel to the capital city for the same tests or care. RESULTS: The telehealth activities contributed to improving medical diagnoses in cardiology and obstetrics (92.6%) and the patients' management system on site (96.2%). The attendance records at health centres increased from 8 to 35% at all project sites during the study period. Patients from project sites saved an average of 12380 XOF (CFA Francs) or 25 USD (American dollar) and a maximum of 35000 XOF or 70 USD compared to patients from neighbouring sites, who must go to the capital city to receive the same care. CONCLUSION: We conclude that in Mali, enhanced training in ultrasound / electrocardiography and the introduction of telehealth have improved the health system in remote areas and resulted in high levels of appropriate diagnosis and patient management in the areas of obstetrics and cardiology. Telehealth can also significantly reduce the cost to the patient.

Enhancing research capacity of African institutions through social networking.

Traditionally, participation of African researchers in top Biomedical Informatics (BMI) scientific journals and conferences has been scarce. Looking beyond these numbers, an educational goal should be to improve overall research and, therefore, to increase the number of scientists/authors able to produce and publish high quality research. In such scenario, we are carrying out various efforts to expand the capacities of various institutions located at four African countries - Egypt, Ghana, Cameroon and Mali - in the framework of a European Commission-funded project, AFRICA BUILD. This project is currently carrying out activities such as e-learning, collaborative development of informatics tools, mobility of researchers, various pilot projects, and others. Our main objective is to create a self-sustained South-South network of BMI developers.

Relevance and usability of a computerized patient simulator for continuous medical education of isolated care professionals in sub-saharan Africa.

OBJECTIVE: to explore the relevance and usability of using a computerized patient simulator as a tool for continuous medical education and decision support for health professionals in district hospitals in Sub-Saharan Africa. METHODS: based on the diagnosis pathway and decision analysis in uncertainty context, interactive clinical vignettes are developed using VIPS, a computerized patient simulator, taking into account clinical problem situations whose relevance was identified. Vignettes were adapted to take into account local epidemiology, availability of diagnostic and therapeutic resources, and local socio-cultural constraints. The evaluation on VIPS software was made by care professionals and students. RESULTS: a computerized patient simulator can be used to provide initial and continuing medical education in Sub-Saharan Africa. But many challenges exist. CONCLUSION: further research is needed to measure potential improvements in knowledge, skills, decision-making abilities as well as patient outcome.

Deploying portable ultrasonography with remote assistance for isolated physicians in Africa: lessons from a pilot study in Mali.

OBJECTIVE: Demonstrate the feasibility of deploying portable ultrasonography with remote assistance to improve the diagnostic capabilities of isolated physicians in Africa. METHODS: The approach is based on the training of general practitioners for the use of ultrasonography, and the remote support by radiologists using dedicated tools for image transfer over low-bandwidth internet connections. RESULTS: Our early results in a pilot project in Mali show that this approach is feasible, and that isolated physicians can productively use ultrasonography to improve diagnosis and management decisions such as the need for a medical evacuation towards a reference hospital. CONCLUSION: These encouraging early results must be confirmed by larger-scale studies, in order to better understand the organizational requirements and demonstrate outcomes and return on investments for such telemedicine services. This scale-up project will start in 2010 in collaboration with the International Development Research Center of Canada.

Open source challenges for hospital information system (HIS) in developing countries: a pilot project in Mali.

BACKGROUND: We are currently witnessing a significant increase in use of Open Source tools in the field of health. Our study aims to research the potential of these software packages for developing countries. Our experiment was conducted at the Centre Hospitalier Mere Enfant in Mali. METHODS: After reviewing several Open Source tools in the field of hospital information systems, Mediboard software was chosen for our study. To ensure the completeness of Mediboard in relation to the functionality required for a hospital information system, its features were compared to those of a well-defined comprehensive record management tool set up at the University Hospital "La Timone" of Marseilles in France. It was then installed on two Linux servers: a first server for testing and validation of different modules, and a second one for the deployed full implementation. After several months of use, we have evaluated the usability aspects of the system including feedback from end-users through a questionnaire. RESULTS: Initial results showed the potential of Open Source in the field of health IT for developing countries like Mali.Five main modules have been fully implemented: patient administrative and medical records management of hospital activities, tracking of practitioners' activities, infrastructure management and the billing system. This last component of the system has been fully developed by the local Mali team.The evaluation showed that the system is broadly accepted by all the users who participated in the study. 77% of the participants found the system useful; 85% found it easy; 100% of them believe the system increases the reliability of data. The same proportion encourages the continuation of the experiment and its expansion throughout the hospital. CONCLUSIONS: In light of the results, we can conclude that the objective of our study was reached. However, it is important to take into account the recommendations and the challenges discussed here to avoid several potential pitfalls specific to the context of Africa.Our future work will target the full integration of the billing module in Mediboard and an expanded implementation throughout the hospital.

The RAFT network: 5 years of distance continuing medical education and tele-consultations over the Internet in French-speaking Africa.

Continuing education of healthcare professionals is a key element for the quality and efficiency of a health system. In developing countries, this activity is usually limited to capitals, and delocalized professionals do not have access to such opportunities, or to didactic material adapted to their needs. This limits the interest of such professionals to remain active in the periphery, where they are most needed to implement effective strategies for prevention and first-line healthcare. Telemedicine tools enable the communication and sharing of medical information in electronic form, and thus facilitate access to remote expertise. A physician located far from a reference center can consult its colleagues remotely in order to resolve a difficult case, follow a continuous education course over the Internet, or access medical information from digital libraries or knowledge bases. These same tools can also be used to facilitate exchanges between centers of medical expertise: health institutions of a same country as well as across borders. Since 2000, the Geneva University Hospitals have been involved in coordinating the development of a network for eHealth in Africa (the RAFT, Réseau en Afrique Francophone pour la Télémédecine), first in Mali, and now extending to 10 French-speaking African countries. The core activity of the RAFT is the webcasting of interactive courses. These sessions put the emphasis on knowledge sharing across care professionals, usually in the form of presentations and dialogs between experts in different countries. The technology used for the webcasting works with a slow (25 kbits/s) internet connection. Other activities of the RAFT network include visioconferences, teleconsultations based on the iPath system, collaborative knowledge bases development, support for medical laboratories quality control, and the evaluation of the use of telemedicine in rural areas (via satellite connections) in the context of multisectorial development. Finally, a strong emphasis is put on the development of capacities for the creation, maintenance, and publication of quality medical didactic contents. Specific courses are organized for the national coordinators of the network to develop these competencies, with the help of the Health-On-the-Net Foundation. The richness of the plurality of knowledge and know-how must be steered towards emulation and sharing, respectful of each partner's identity and culture. Collaborations with UNESCO and WHO have been initiated to address these challenges.

Assessment of Internet-based tele-medicine in Africa (the RAFT project).

The objectives of this paper on the Réseau Afrique Francophone de Télémédecine (RAFT) project are the evaluation of feasibility, potential, problems and risks of an Internet-based tele-medicine network in developing countries of Africa. The RAFT project was started in Western African countries 5 years ago and has now extended to other regions of Africa as well (i.e. Madagascar, Rwanda). A project for the development of a national tele-medicine network in Mali was initiated in 2001, extended to Mauritania in 2002 and to Morocco in 2003. By 2006, a total of nine countries are connected. The entire technical infrastructure is based on Internet technologies for medical distance learning and tele-consultations. The results are a tele-medicine network that has been in productive use for over 5 years and has enabled various collaboration channels, including North-to-South (from Europe to Africa), South-to-South (within Africa), and South-to-North (from Africa to Europe) distance learning and tele-consultations, plus many personal exchanges between the participating hospitals and Universities. It has also unveiled a set of potential problems: (a) the limited importance of North-to-South collaborations when there are major differences in the available resources or the socio-cultural contexts between the collaborating parties; (b) the risk of an induced digital divide if the periphery of the health system in developing countries is not involved in the development of the network; and (c) the need for the development of local medical content management skills. Particularly point (c) is improved through the collaboration between the various countries as professionals from the medical and the computer science field are sharing courses and resources. Personal exchanges between partners in the project are frequent, and several persons received an education at one of the partner Universities. As conclusion, we can say that the identified risks have to be taken into account when designing large-scale tele-medicine projects in developing countries. These problems can be mitigated by fostering South-South collaboration channels, by the use of satellite-based Internet connectivity in remote areas, the appreciation of local knowledge and its publication on-line. The availability of such an infrastructure also facilitates the development of other projects, courses, and local content creation.